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(5j) METHOD FOR CODING OR DECODING; T[IME-VARYING IMAGE; AND APPARATUSES (FOR 
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© The apparatus for coding a time-varying image divides the image signals whose Image franne is N pixels x 
M lines (N pixels horizontally and M lines vertically) into a first image part which is an inner image portion having 
an image frame of Ni pixels x Mi lines (Ni ^ N -and Mi ^ M), and a second image part which is the image 
portion outside the first image part. The first image part and the second image part are further'divided into given 
independent division units each formed by a plurality of pixels. When- the coded information is about given 
division units belonging to the. second irhage part. an^Ldentifiqation code is added to the header of each division 
unit. If the apparatus is only capable of decoding the image frame of ;Ni^ pixels, x Mi ^Jines, the apparatus 
reproduces only the first image part The apparatus recognizes the identification code added to the header of a 
division unit belonging to the second image part, and skips over the coded information* of the -second image part. 



UJ 



J Rank Xerox (UK) Business Services 

BNSDOCID: <EP 0650208A1J_> (3.10/3.09/3.3.4) 



No 



EP 0 650 298 Al 



Mo 



f - ' ■ 


^ . PICTURE 
1 PORTION G2 






M1 LINES 




PICTURE 
PORTION Gl 


/ N1 PIXELS '^ 





M LINES 



N PIXELS- 



V If \ 



EP 0 650 298 A1 



Technical Field 

This invention relates to a moving picture coding method for coding a moving picture, a moving picture 
decoding method for decoding a coded moving piciure, and apparatuses therefor. ^ >. » 

Background Art 

In the case of digitizing a 'signal of a moving picture to Record and transmit digital data thus obtained, its 
data quantity becomes extremely large. For this reason, coding (compression) is implemented to that data. 
10 As a representative coding system, there is so called . MPEG (Moving Picture Expert Group) system. This 
MPEG is general name of the moving picture coding system which has progressed in WG (Working Group) ' 
1 1 of SC (Sub Committee) 29 of JTC -(Joint Technical Committee) 1 of ISO (international Standardization ^ 
Organization) and lEC (International Electrotechnical Commission). 

Moreover, as a widely known format in the case of handNng a picture signal by a digital signal, there is 
76 Recommendation 601 (Rec. 601) of so called CCIR (Comite Consultatif Internationale des Radio-commu- 
nications (International Radio Consultative Committee)). This Rec. 601 is the worldwide standardized format 
of digital picture based on the component (so called 4:2:2 ^cpmponent) coding system. 

In the MPEG, the above-mentioend Rec. 60T format is used as input/output picture format. In the NTSC 
zone of the scanning line 525 lines/30 Hz, an input/output picture format as shown in FIG. 11, for example, 
20 has been most popularly used. For example, in MPEG2 (MPEG phase-2), picture of picture frame of frame 
of 720 pixels X 480 lines of Rec. 601 format is handled- On the other hand, in MPEG1 (MPEG phase-1), 
picture of picture frame of frame (SIF) of 360 pixels x 240 lines obtained by thinning pixels so that 
resolutions in the longitudinal and lateral directions are respectively equal to one half thereof is handled; 

A technique to allow the transmission format of picture to have a relationship such that the ratio 
25 between length and breadth of picture frame is expressed as 1 :2 in dependency upon difference of 
resolution is convenient in a hierarchical manner. This is related to the following two reasons. 

First reason is that hardware configuration of thinning filter and/or interpolating filter having ratio of 1 :2 
are simpler than those of filters having other ratios. 

Second reason is that, in the case of constituting picture coding/decoding apparatuses, it is possible to 
30 process picture data by four image LSIs disposed in parallel for picture having resolution which is one half 
of picture to be processed. 

An example of filter coefficients of the thinning filter is shown in FIG. 12. 

Moreover, since there is employed a scheme to handle picture in a manner divided into small blocks 
called macro blocks of 16 pixels x 16 lines, it is preferable that the horizontal and vertical sizes of picture 
35 are multiple of 16 when coding efficiency is taken into consideration. From a viewpoint of this, picture frame 
size of 720 (= 16 x 45) pixels x 480 (16 x 30) lines is preferable size. For reasons described above, in the 
NTSC zone, picture of picture frame of frame of 720 pixels x 480 lines of Rec. 601 format has been widely 
handled. 

On the other hand, CCIR recommended broadcasting stations (television stations) that picture signals of 

40 483 lines or more (about 483 ~ 486 lines) must be transmitted in the standard television broadcasting in the 
NTSC zone. At this time, if picture coding is carried out by MPEG as in the prior art, it is required to 
increase the number of macro blocks by one column in a longitudinal direction to carry out processing of 
720 pixels x 496 (480 + 16)*^lines.. This results in requirement of increase in the coding processing ability of 
about 3.5% as compared to the case where frame of 720 pixels x 480 lines is handled. 

45 This is inconvenient for a system only having a decoding apparatus which can merely handle so far as 
picture of picture frame of frame of 720 pixels x 480 lines. For example, when the recording system of the 
digital video disc and the broadcasting system of the digital television are the same MPEG, it is considered 
that there results the merit that it is sufficient to have only either one of decoding apparatuses. However, in 
the case where decoding apparatus of video disc player has only processing ability of picture frame of 720 

50 pixels X 480 lines, it is unable to receive picture signals in digital television broadcasting by that decoding 
apparatus. This gives rises to extremely waste fronn a viewpoint of effective utilization of hardware resource. 

Meanwhile, CCIR only recommended that picture signals of 483 lines or nnore (about 483 - 486 lines) in 
the standard television broadcasting in the NTSC zone must be transmitted, but whether or not the 
receiving side decodes picture Information of 480 lines or more is arbitrary. For this reason, in the case 

55 where the receiving side is a decoding apparatus having only processing ability of picture frame of 720 
pixels X 480 lines, if it is possible to decode only such picture frame, this is very desirable. 

To meet the above-described requirement, it becomes necessary to realize a moving picture coding 
technology required for providing moving picture coded information (broadcasting) having flexibility and a 
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decoding method therefor such that in the case where the 'receiving side is a'^decoding apparatus having 
processing: ability of picture; frame of 483 lines or more; ' received, all picture- signals can be reproduced, 
while in the case where the receiving side is a decoding apparatus having only processing ability of picture 
frame of. 480 lines, only the decordable picture portion can be reproduced; ' ! - ■ ■ 

5 ' To realize this, it is necessary to soive problems described below. " ' ' • ^ ' . ' ■ 

• First, such a task; must be accomplished to permit discrinhination as to whether or not only picture 
information of reproducible picture frame is taken out from received coded information. 

Secondly, since in- the coding 'method using motion compensating pre'dictibh between pictures such as 
MPEG, etc.,. pictures have correlation therebetween in a* time base direction, in the case where reference is 

10 made to the outside (line portions 'indicated by 16'1ines irf the figure, for example) of the reproducible ' 
picture- frame- by motion compensation as shown in FIG- 13, motion Compensation is unable to be' carried 
out. As a result, decoding cannot be made. Accordingly, it is necessary to take any measure for this 
problem. ' ■ . . ■ • • . : , , ■ i . ^ 

Namely, the- case where coded information of 496 linesMs received'by decoder only having processing 
15 ability of picture frame of 480 lines is taken as an example in FIG. 13. In the case of the example of FIG; 
13, motion compensation in directions indicated by arrows a. b in the figure from within the picture frame of 
480 lines of past picture or future picture to current picture can be' made, but motion compensation in 
directins indicated by arrows c, d in the figure from within* 'tha picture frame beyond 480 lines of past 
picture or future picture (line portions indicated as 16 lines in the figure) to current picture cannot be carried' 
20 out. 

Disclosure of the Invention . • \ ' * j 

, In view of the above.'in order to satisfy the above-mentioned requirements, an object of this invention is 
25 to provide a moving picture coding method required for providing moving picture coded information 
(broadcasting) having flexibility and a decoding method corresponding thereto such thatMn the case where 
the receiving side is a decoding apparatus having processing ability of picture frame of 483 lines or more, 
received alt picture signals can be reproduced, while in 4he case .where the reeieving side Is a decoding 
apparatus having, only processing, ability of picture frame of 480 lines, only the reducible picture portion can 
30 be reproduced. 

..This invention has- been proposed in order to solve the above-described problemsi A moving ^picture 
coding method of this invention comprises the steps of; dividing a picture signal of a picture frame of N 
pixels X M lines (horizontal N pixels, vertical M lines) to be coded between a first picture portion serving as 
an internal picture portion having a picture frame of Ni pixels. x Mi lines (Ni ^ N, Mi £ M) and a second 

35 picture portion serving as a picture portion outside the first picture portion; and dividing the first picture 
portion and the second picture portion in independent predetermined divisional units, comprised of a 
plurality of .pixels, whereby .in transmitting coded information vof the predetermined divisional units belonging 
to the second picture portion, peculiar discrimination codes are respectively added to headers of the 
divisional units. ■ . . ... ^ • 

40 In the above-mentioned mpving.fpicture coding method, at the time of.motion compensating prediction, 
it is inhibited that the, first picture portion of^a current coded picture makes reference to the second picture 
portion of reference picture. Moreover, motion compensating prediction implemented to the second picture 
portion of current coded picture does not place restrictions on reference picture. ■ , ; . ■ 

It should be noted that when size of unit block for carrying out motion compensating prediction is 

45 assumed to be N2 pixels x M2 lines, setting is made such that Ni is multiple of N2 and Mi is multiple of 
M2. In addition, setting is made such that Ni and Mi are both multiple of 16. 

Further, a moving picture decoding method of this invention is characterized. in that when only decoding 
ability of the picture. frame of Ni pixels x Mi lines is provided, only the first picture portion is reproduced, 
and any one of peculiar discrimination codes added to headers of predetermined divisional units comprised 

60 of a plurality of pixels belonging to the second picture portion is detected with respect to the^second picture 
portion to thereby discriminate the second picture portion, thus making it possible tO: read, in a skipped 
nnanner, coded infornriation of the second, picture portion. - < j j - 

Also in this decoding method, when size of unit block for, carrying, out motion compensation is assumed 
to be . N2, pixels x M2 lines, Ni is multiple of ,N2 and.Mi is multiple pf .M2. In addition, Ni and Mi are both 

66 multiple of 16. ' ^ / , , , . > , ^ 

Meanwhile, for exanriple, in the casq where , a frame picture signal to t)e transmjttedris .a picture signal of 
483 lines or more required for the television broadcasting of the NTSC system, the first internal picture 
portion becomes 480 lines. ' 



4 



EP 0 650 298 A1 



In this case, frame picture signal of 483 lines or more required for the television broadcasting of the 
NTSC system is divided between a first picture' portion of 480 lines and a second picture' portion serving' as 
a picture portion of the highest pprtion:or the lowest portion of the picture except for the first picture portion, 
whereby when.- only decoding ability, .of. picture.;frame of 480 tines is provlded, only the first-picture portion iS' 

5 reproduced, and any one of peculiar, .discrimination codes added to headers of predetermined divisional 
units comprised of a plurality of pixels jDetpnging.to the second. picture portion, is detected with respect to 
the second . picture^ portion to .thereby idiscriminate,. the. second picture portion ?thus; to read, in a skipped 
manner, coded information of the second picture portion.- » ,1 * . - - 

In accorciance with this invention, in. coding moving picture, picture signali of picture frame of N pixels x 

10 M. lines (horizontal. N pixels, .vertical, M lines) to be coded Js divided. between first picture- portion serving as. 
the internal , picture portion . having picture frame of . fvli » pixels x Mi lines (Ni ^ N, Mi ^ M) and second, 
picture portion serving as picture portion. Qutside the first picture portion to divide the first, picture portion . 
and the second .picture portion in .independent predetermined divisional units comprised of plural pixels, 
whereby in transmitting coded information of the predetermined divisional units belonging to the second 

75 picture portion, peculiar discriminatipn codes, are respectively added to headers of predetermined divisional 

units. ^ \ . -i.-u . i 1' -i ■ • . • ; ' V • 

Accordingly, in the case wheretpnly decoding ability .of picture frame, of Nrfpixels x Mi lines is provided- 
when, such a .coded signal is decqded, only the. first picture portion Js reproduced, and- corresponding 
peculiar. discrimination code is detected,' with, respect to the -second picture portion to thereby discriminate 
20 the second picture portion, ithus making .itipossible to .read, in a skipped manner, coded inforrYiation of that 
picture portion. 

Brief Description of the Drawings ; ^ . . 

25 FIG. 1 is a circuit diagram showing, in a -block, form," . a moving picture coding apparatus in ""sf^ first 
, embo,diiT»ent of this invention. . v* . -. i ^ ' . ' ■ - -i : = ! . .^t 

FIG. 2 is a . view showing .data structure of MPEG 1. j ' -f? i.' . • ' - ■ - ii ; - 

FIG. 3 is a view for expiaining. I, P and -B pictures.: -m^i i - • ' = ' - ' ■» -* - " 

FIG. 4 is -a view, for explaining! handling of pictuFO' In' thiis embodiment, - " •'. - ' - • • - 

30 ■ FIG. 5;is a circuit diagram showing,- m-^ -block fomR,^ a'nrioving picture- decoding' apparatus- in tfe^firist 
embodiment of this invention. * ; 

FIG. ;6, is a circuit* diagrarn showing, -in a block form, a moving picture coding apparatus in a se^cond 
{embodiment. . l ' • • . ■ *- ■ ; ; - 

•FIG."7 is a view for. explaining handling of picture* at the frartib structure in the sfecond embodiment.^'^ 

35 tFIG. 8 is a circuit diagram showing ' in a block form, a moving picture decoding apparatus in the second 
embodiment.} . ; > ^ • t • - m • < 

FIG. 9 is a view for explaining conventionai handling of picture of the field structure.' - 
: FIG.t„10 is .a ,view for explaining handling- of Extras SNee-in ; picture: of the field structure in this 
embodiment. ■ ; ^ , ,c.. . 'j^.- . ■ i?/- . . - h e k . '.-I, ■. ^ • - ' ^ 

40 FIG. 11 is a view showing Rec. 601 format and SIF format. 

FIG.f12 iS) a- view showing an example «of frlter coefficients'bf the thinning-filter. ' - = . 

.FIG. 'liS^is a. view, for explaining .the problem in the' case where' when the receiving' side is a decoding 
apparatus having only. processing' ability- of picture frame of 480 llnes; an attempt is made to decode 
coded information of picture frame- of 496 lines. . • ' - 

Best Mode for Carrying Out the lnver>tion . - . . . r., f '1; , . 

•Preferredembodiments-of this invention" wilf now be described 'with' reference to the attached drawings. 
A< moving picture coding ^apparatus (encoder)- of a first 'embodiment to whiioh a nribving picture' coding 
60 method' of this- invention is applied will be described' in accordance with FIG; 1 . It Is to be noted that whil^ 
this invention can }^e applied to the case* 'where "picture structure is both frame and field strijctures,' the'case 
where ithe picture structure is baused to be frame structure Vvill^be chiefly describ'e'd in this emk^^bdiment. 

In FIG. 1, a moving picture to be coded is inputted fro'rn' picture inpiut termfhal ' lb. Picture signal 
inputted fronh the picture input termin'ahIO is 'delivered to fie^ld mertibry group 11.' ^ * ' V 
55 " In the coding apparatus 'df this WmBo'diment, inpijfted picture is caused to undergo coding ori the basis 
of data structure at MPEG1 as shown in FIG. 2. 

Reispective- data layers 'shown iri FI6.'i21n "this embodir^ ' - " 
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1. Blopk layer. s ■ ^ * ^ ' ^ 

.Block of .block layer is comprised of, e.g., 8 lines x 8 pixels adjacent of ^lurrii nance or color difference. 
For example, Discrete Cosine Transform (DCT) processing is carried out in this unit (block). 

2.. MB (Macro Block) layer ' t - r . ' ' ( ^ . < ' 

Macro Block (MB) of macro block layer is such that in the case where, e.g. , format of picture is 4:2:0 
(ratio between information quantities of luminance signals and:-two color- difference signals is" 4:2:0), it is 
10 comprised ;Of. six blocks Jn total of fouri.luminanc0. blocks. adjacent .in left and. right directions and in- upper 
and lower directions, and respective color difference blocks of Cb,;Cr:. corresponding to the same position on 
picture. Transmission is made in order , of YO,; Y1, y2, ! Y3, Cb, sGr.. What mode is used' as motion 
compensation mode, and/or whether or not it is sufficient to transmit. no predictive error are' judged' in 'this 

unit, . . ; V . ■ ■ . ' ■ : . ' ' ' : • ■ . • ■, - < ;'j • ■ ■ -.r' , > . . . ■ * * ■ 

3. Slice layer , s. : , . ; . - • . a ^ • ' ' ' • 

- • ; . MJ ^ ■ . ■ i ; '■: ■ ■ »-t ■ '■ ; : • ■ ■- ' . . " • 

. .Slice layer is. .comprised^ of a, single macro block or a plurality of macro blocks successive in order of 
scannirig of picture. At the leading portion of , slice,, the first macro block has .data indicating position within' 
20 picture so that data state can return to nprrrial . state even .in thejcase, where any error takes place. .For this 
reason, the length of slice and starting position , are .arbitrary , thereby making ; it 'possible to vary them in 
dependency upon error; state of transrrilssion path.. - ; ' . .i i , *^ - ' ' 

4. Picture layer ^ , - , ; ' - , ' -r- ■ ' • • • 

25 . .^^ ; , . . < . -M... I , ^ ^ . \ 

Respective pictures, i.e., Jndividua! pictures- are connprised of . at least one slice or a pfurality of slices. In 
acordance with the^. system in. which picture^s ar.e, coded, respective pictures are classified into K picture. 
(lntra;Coded pictur^e), P picture (Predictive^cpded pictur,e),:,B % Predictive-coded pic- 

ture). Here, I picture, P picture, and B picture will be.desprib^d with reference tp^FlG.. 3. in FIG.' 3. first, as 

30 processing of the first stage, pictures indicate^d by "P"; in ^ the figure jumping, pver several pictures, are 
caused to cyclically undergo predictive codir^g, Then.^as prqcessiag pf the, second stage, pictures indicated 
by "B" in.ttie figure which, is put between I picture.and P„picture;pr between P pictures are predicted from 
P picture or I picture before and after. It is to be noted that picture indicated by "I"' iri the figure is intra- 
coded picture, and is prepared without use of nnotipn compensation. It. is to be further noted that arrov/s in 

35 the figurie represent directions of prediction. ^ . ■ . ' rr-,u 

5. GOP layer 

GOP (Group of Picture) is comprised of single or plural i pictures, or single or plural I pictures and 
40 plural non I pictures. 

6. Video sequence layer 

Video sequence is comprised of single or plural 'GOPs having the same picture size and picture rate, 

45 etc. 

Turning back to FIG. 1 . information for controlling fundamental operation of the coding apparatus of this 
embodiment is given from picture coding control information input section (labeled control information 
external input section in the figure) 29, and is stored into memory (labeled memory for picture coding 
control information in the figure) 30. These information are picture frame size, output bit rate of coded 
50 information, picture structure signal (discrimination signal as to whether picture is frame structure, field 
structure or progressive), and picture coding type signal (discrimination signal as to whether picture is I 
picture. P picture or B picture), etc. These information are outputted as picture coding control signal 825. 

Moreover, layers of video sequence, GOP, picture and slice of data structure at MPEG1 are such that 
start codes indicating that those layers start are added to the leadirig portions of respective layers, and 
65 header information are adapted to be transmitted after those start codes. 

Timings for transmitting respective start codes are given when video sequence start flag 820, GOP start 
flag 821, picture start flag 822, slice start flag 823 are set, respectively. Video sequence start flag 820, 
GOP start flag S21 and picture start flag S22 are outputted from picture counter 27. Moreover, slice start 
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flag S23 is outputted from MB (Macro Block) counter 28. 

Picture counter 27 detects the leading portion of picture which is to be currently coded and is read but 
fronn field memory group 11 to count its number in synchronism with signal S30 outputted therefrom. 
Picture counler 27 is: reset' when coding of- video sequence to be coded is started. At that time/ video 
5 sequence start flag S2a is tsettat the same time; Picture start flag S22 is sel when picture counter 27 has 
received the signal S30. 60P start flag S21 is set when picture count number becomes equal to multiple of 
GOP length (No. of pictures for preparing GOP) determined in advance. Ordinarily, GOP lenlgth is, e.^T. 12 
frames or 15 frames. This information is preserved in memory 30 where control information for coding of 

current picture is stored.* - . , ■ m. >:•■..', - . • ' • •••• 

10 . In this, embodiment, the coding apparatus- handles picture as shown in FIG. 4. = ' 

Namely, picture signal of picture frame of N pixels x M lines (horizontal N pixels, vertical M lines) to be 
coded, is .divided between internal picture-' portion (first* picturer- portion) having 'pixel frame of Ni pixels x Mi 
lines (N, S N, M) ^. M) indicated by picture portion Gt and picture portion (second picture portion) outside 
the, picture portion Gi , which is indicated- by* picture portion G2, 'to constitute picture portion Gi by one 

75 general slice or more, and to constitute picture portion G2 by one Extra Slice or more. It is to be noted 

that Extra Slice is name employed in this embodiment for distinction from general slice. Extra Slice is 

comprised of macro blocks (MBs) in the same manner as in the general slice. ' ' 

MB (Macro Block) counter 28 is reset in response to the signal 830. MB counter 28 detects the leading 
portion of MB pixel signal S1 Which is to be currently coded and is read out from field memory group 11 to 
20 count its number in synchronism with signal -SSI outputted therefrom. ' 

In. the . case where position of ' Macro Blo'ck (MB) to be processed* shifts from picture portipn Gi to 
picture portion G2, sUce start! flag -823 is set, arid the Extra_;8lice_[_Status_Flag 828 is set. Furthlsr. in the' 
case where position of Macro Block (MB) to be processed shifts from picture portion G2 to piicture'' portion 
Gi , slice start flag 823 is set, and Extra__81ice_8tatus__Flag 828 is reset. Shift timings of positions of 
25 these Macro Blocks (MB) can be recognized by observing MB count number at MB counter 28.^ ' 

Also in the case where MB count number becomes equal to multiple of slice length (No. of macro 
blocks for preparing slice) determined in advancd, ^lice start flag 823 is set. In the case where otHSwise, 
slice start flag 823 is reset. The slice length can be changed ' by error state of transmission patK*brbii' 
stream. In general, according as -error ■probabVlity^'df^ransm path becbm'e^ higher,' the slice. length' 

30 becomes shorter- Slice length designated at' this'liriie'i's'stoVed iri meimory '30.^ ' ' ' ' ' ' ' * ' ' 

• Whem sequence start flag 820,- GOP 'staW fidig 821,^ picture start flag'*S22, or d lice start flag 823 is set, 
VLC element'20 outputs start code'of cdrrespohding layefih response theretb. Subsequently, VLG element 
20 outputs therefrom, as header infomnf^tion,' control infdrmatioh for coding data of corresponding-layef 
preserved in .memory 30. ' " - ' • ' • ^- i • 

35 . Here, by introducing "Extra_;_Slice", bit stream syntax of sequence layer and slice' layer are changed'as 
compared to conventional MPEG 1 . , ' • . * 

Bit stream syntax of sequence layer is shown in Table 1 . 
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25 



30 



35 



Table ; 

seqence_header ( ) { 

sequence_header__code ; 

hori2ontal__size_value ; ^ . , . . , 

vertical_sl2e_value ; ^ 
pel _aspect_ratlo ; 

picture _rate ; ^/ 

bit _rate ; . ^ . 

marker_blt; 

vbv _buf f er_size ; 

constrained _pararaeter _flag:; 

load_intra ^quantizer _matrix; 

If (load _iintra '^quantizer rrnaatrlx) 

, intra __quantlzer _niatr ix [ 64 ] ■ 
load_non _lntra ^.quantizer ^matrix; 
if (load __non _intra ^quantizer _matrlx) 
non _intra ^quantizer _matr Ix [ 64 ] ; 



32bit 
12bit ; 
12blt; 

4bit i 
. . ; 4bit 
ISblt 

Ibit 
lObit 

ibit 
. Ibit 

.8»64bit 
Ibit ; 

8#64bit ; 
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15 



25 



30 



35 



40 



45 



60 



next__start __code(); 

if(next _bi ts (,) = = extension Istart _code) { 

extension start code; • . . 32bit 



usin^ _extra _slice _flag:; ' ' Iblt 

if (usin&_extra _slice _fla^) { . ^ " 

inner __iiib_width ; ' ' ' /12bit 

inner __mb_heig-ht ; • ■ - 12bit 

bffset_slice _hor izontal_posi t ion ; ' * 12bit 

offset_slice _ver tical_posi t ion ; - *• * 12bit 

. y • , . . . ■ 

reserved (byte _al i g'n ).; - ■ • ' = . r 
while (next_bits() ! = ' 0000 0000 OOOQ 0000 0000 0001*)^ v { 
sfequence_extension _data; ' ' ' " ' ' ; ^8bit; 

■ > -^-^'^ ' - ^ ■ - ■• - 

next_start _c6de('); ' ' ' ' 

' * ■ - ' ' • * 

if (nextbits ( ) =user__data_start _code) { 

user__data_start __code ; 32blt; 
while(next_bits( ) != '0000 0000 0000 0000 0000 0001*){ 
user data; Sbit; 

} 

next_start __code(); 

} 



In the sequence layer, information relating to positions of picture portion Gi and picture portion G2 are 
55 transmitted. These Information will be described below with reference to FIG. 4, The case where, e.g., size 
of Macro Block (MB) is 16 pixels x 16 lines in FIG. 4 will now be described. 

In Table 1 and FIG. 4, at sequence layer, lateral sizes (i.e. N) and longitudinial sizes (i.e. M) of all picture 
frames are transmitted by "horizontal size Rvalue", "vertical size value". Further, information indicating 



BNSDOCID: <EP 0650298A1_L> 



EP 0 650 298 A1 



whether, or not Extra__Slice is used is transmitted by flag expressed as "using-extra_sllce_flag"; In the 
case where Extra__Slice is used, lateral size and longitudinal size ot picture -portion Gv are transmitted by' 

"inner rnb__width", "inner__mb^ height", it is to be. noted that the inner;_mb width indicates No. of 

Macro~Blocks:(MBs) which fall within lateral one column of picture portion GiV* and' ihe inner___mb_heighr 

5 indicates No. of macro blocks which fall within longitudinal one column of picture portion Gi . Namely, in the 
case ' where size of - Macroi Block (MB) is^ 16 pixels x 16 ' lines/= mb_width = N/16, mb__height = M/16, 

inner mb width = Ni/16, and inner_mb height - Mi /1 6. * * ' ' ' ' ' 

; Further, position information of picture portion Gi within N pixels x M lines of the isntire picture frame is 
transmitted by " ' offset__slice__horizontal_position"v "offset_sliGe_vertical-position". Namely, "off- 

10 set slice horizontal position" is No/16'and "offset__slice__vertical-position" is Mo/16, 

Bit stream syntax of slice -layer- is shown in Table 2. "slice_start__code" is xOOOOOIOT - xOOOOOIAF 
and the lower order 8 bits indicate Slice Vertical Position on the^ entire picture frame (NxM) of that slice. In 
the case where Extra_;Slice is' used,, flag "extra^slicej_flag ''J- indicating whether or not that slice is * 
Extra fSlice is transmitted: When Extra_SI ice Status_Flag S28 is set, this ■"extra_slice_f tag" is'set'to 1. 

,.1 ; i ...... ' , . - ! ■ ' 

siic€j( )• = { ' ' ■ ■;' ' ; / . \. 

20 slice _start _code; H > m! : " > 32bit ; 

quantizer _scale; ' r , ; • ^ 5'bit : ' • 

' If (us.ing_extra ._sltGe _flag) .. { . . ' ; 

extra _blt v^slice; . lbit=' 1' 

. . e?ctra: _^sllce .^f lag : . .'>;.c.: > - Ibit 

30 . /# **1*^ extra _slice /'0*\ not _extr;a^ is , - . : 



35 



40 



50 



66 



reserved; . ^ * 7bit; ,,. 

} • . ■ ' ■ ^ - \y ■ ■ ' - \ ^ . 

while(next_[bits( )' = =• 1* { ' ! i' ' : , .^^Z 

extra _blt _sllce; ' ' " ' ' /'[''' 

extra J^inf ormatlon' _slic'e ; ^ . ' . , . ^^^^"^ v 

} ■ ■ ; ' ■ ' ' ' ' " ' "'^ ^ / \, 

extra _bit„slice; \ lbit="0" 

. macroblock (i ) : , r • . 

} while(nextlblt^( ) J = :.OO0O 0000 0000 0000 00,00 tOOQO ') ; 
next start. cpde.() ; . . , ■ - . • . 



.Turning, back, ^tp. FIG. 1. vertical syrichronizing signal serving as, input, picture synchronizing signal Is, 
dejivered from input .terrnjnal .26, and is delivered to, reference picture^ .cpntnol element 23. Responding to 
this synchronizing signal, the reference picture control element 23 outputs reference picture indication 
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signal S10 which will be described later to deliver it to field memory group 11. 

„The field memory group 1 1 sets picture start. flag S22 in synchronism with the leading portion of- picture' 
which is to be currently coded, and is read out therefrom to deliver it to reference picture control elerrient 
24. The reference picture control :element 24 outputs reference picture indication signals SI 2, SI 3 which' 
5 will be described later wheo picture start flag S22 is set to deliver them to field memory group 17.- • . 

.Moreover, picture start i flag S22 is .delivered also to..; output picture control element 25. The output 
picture; control. element 25 ioutputs output picfnjre indication signal S14 which wilLbei described later when 
picture start flag. S22 is set to deliver it to field memory group^l 7. . • • 

Motion predicting circuit (predictor) 12 carries out motion prediction of macro block pixel signal SI -to 
10 be currently coded which is delivered from field memory. group 11. by making reference to' past picture and 
future picture. Motion prediction is block-, matching between, macro block of macro. block pixel signal S1 and* 
each nf;iaGra block , of past, picture or future picture to which reference is made. Past and future reference 
pictures- at, this time are designated frp.m fieJd imemory .-group r11 in -accordance -with motion predictive- 
reference picture .indication signal S10 putputt^d fro.m reference picture control element 23. As. a result, 
16 reference picture signal. 81 ;1. of reference picture, is- delivered to imotion predicting circuit 12. The motion 
predicting circuit 12 delivers, as motion vector signal S7; block position within reference picture in the case 
where predictive error at block matching is minimum to motion compensating circuit (compensator) 18. 

Here, when corresponding macro block is macro block (MB) at the picture portion Gi , i.e., when it is 

macro block (MB) within general slice and Extra Slice Status Flag S28 is not set, restriction is placed on 

20 the operation of motion predicting circuit 12. In this case, it is inhibited to make reference to picture portion 

G2, i.e., picture portion G2 of reference picture (within Extra Slice) at the time- of motion prediction.- On the 

other hand, when corresponding macro block is macro block (MB) at picture portion G2, i.e., it is macro 

block (MB). within Extra Slice and the Extra Slice Status Flag S28 is set, it Is not necessarily required to 

place restriction on the operation of motion predicting circuit 12. 
25 Motion compensating circuit 18 instructs field merhory 'group 17 in which pictures already decoded :and 

reproduced which will be described later are stored to output therefrom block picture signal S3 positioned 
at an address designafed by motion vector signal S7. Reference picture at this time is de^signated from>^field 
memory group 17 in accordance with motion compensation reference picture indication signal S12 
outputted from reference picture control element 24. Outputting of block picture signal S3 from motion 
30 compensator 18 is adaptive operation. It is thus possible to carry out switching to optimum one of four kinds 
of operations described below in nnacrb block units. ' ' ' [ ' — • • ' ? - 

Namely, modes of four kinds of operations are as follows: 
First, motion compensation mode from past reproduction picture; 
Secondly, motion compensation mode from future reproduction picture; 
35 Thirdly, motion compensation mode from both past and future reproduction pictures (to carry out linear 
operation (e.g., mean value calculation) every pixel of reference block from past reproduction picture and 
reference block from future reproduction picture); and 

Fourthly, mode of no motion compensation (i.e., intro-coded rnode. In this case, output of block picture 
signal S3 is equal to zero). 

40 It is to be. noted that, in the case of I picture, only the fourth motion compensation mode, is .selectable. 

Moreover, in the case of P picture, the first and fourth motion compensation modes are selectable. In 

addition, in the case of B picture, the above-mentioned all motion compensation modes are selectable. : 
In switching between the modes mentioned above, e.g., mode where sum total of absolute values of 

difference values every pixel between respective block pixel signals S3 outputted in the above-mentioned 
45 four kinds of modes and block pixel signal SI to be currently coded is minimum is selected. • Here, the 

selected mode is outputted as motion compensation mode signal S9 and motion vector signal S8 at that 

time. 

Block pixel signal SI to be currently coded which is delivered from field memory group H and block 
pixel signal S3 delivered from motion compensator 18 are caused to undergo calculation to obtain 
50 difference value every'pixel at subtracter 13. As* a resulij 'block difference signal S2 is obtained. ' ''' 

This block difference signal S2 is delivered to block signal coding sectipn 14, resulting in coded signal 
S4. This coded signal S4 is delivered to block signal decoding section 15, at which it is'"decdded. Thus, 
block reproduction difference signal S5 is obtained. 

As configuration of the block signal coding section 14, configuration composed of a DCT (Discrete 
65 Cosine Transform) element and a quantizer for quantizing output coefficients therefrom by quantization 
table signal S15 designated from buffer memory 21 may be applied. In this case, as configuration of block 
signal decoding* section 15, 'configuration compibsed of an Inverse quantizer fbr" inverse-quantizing quantiza- 
tion coefficients* by ic^uahtizatioh' ' table signal' SI 5 - and 'an inverse DCT elerrient for' allowing output ' 

11 

BNSObciD: <EP 065029eA1_L> 



EP 0 650 298 Ai 



coefficients therefrom to undergo inverse =DCT, processing: "h - , 

. Tlie above-mentioned block reproduction difference .signal S5 is added., every: pixel, to block picture 
signal 'S3 outputted from motion .compensator 18 at adder l 6-.As a result.;.bloct< reproduction signal S6 is 
obtained.;. . , > . , ... , . „ , ■ , 

This block reproduction signal S6 is stored lintO'^field metnoryi designated ^by- current picture indication 
signal SI 3. from field memory group 17v Designated reproduction picture of reproduction pictures stored in 
the field memory group .17 is outputted from terminal 29 in accordance with the previously described output^ 
picture indication signal Si 4.. ... , , , .. ■. 

On the other hand, block signal S4 is delivered to one-dimensional signal generating' section' 19. at 
which it is stored in one dimensional array. Thus, one-dimensibrial coded signal 816 is obtained. 

The one-dimensional- generating signal section- 19 is comprised of. e.g., a scan converter for implement- 
ing so,. called zigzag scanning to block quantization DGT coefficients' in order of coefficients from low 

frequency. toi high frequency. - . f.; <, . - . = , . . 

^ Moreover, the above-mentioned coded signal SI 6 is- converted into variable length code such as 
Huffman, fcode, etc. at VLC element (Variable Length. Coding-^ Element) 20 along with motion vector signal 
S8, motioni compensation mode.signal S9. - and; quantization table: signal S15.' etc. They are = stored into 
buffer memory 21. Thereafter, bit stream is sent from output terminal -22' at a predetermined transmission 
rate. - ; ' - 

Moving picture coding apparatus is constructed in a manner stated above, thus to carry out coding of 
moving picture, output of bit stream, and output of coded picture.'} • 

A moving picture decoding apparatus (decoder) to which a moving picture decoding m.sthod of this 
invention is applied, which corresponds to the codings apparatus of the. embodiment to which the above- 
described moving picture coding method of this invention is applied .will now be described with' reference to 
FIG. 5. i • i ' . 

In FIG. 5. bit stream, signal, inputted from input terminal 50 is. stored into buffer memory Sli. and is then 
delivered to inverse VLQ,element. 52.; . . . - r.\ ^ ; . / ^ 

As, explained =on , the coding apparatus side. -bit stream is composed of six layers, i.e.. video sequence 
layer, GOP layer, picture layer, slice layer, macro. t)(ock layer.^and block layer. . ; ^ 

s\n the.case of video sequence layer, GO^F^ layer,. picture layer.and- slice layer, start codes indicating that 
respective. layers begin,, which are attached to the Jeading portions -of respective layers, are first received 
and header information for controlling decoding of picture, are; then received. . - . 

Inverse VLC element 52 decodes, header information of respective layers when it receives respective 
?tart .codes to, store control information for decoding of pictures ithus obtained into memory 201. Information 
stored in. memory 201 controls the moving picture decoding apparatus as control= information 8104 to 
decode pictures in a manner described below. , , 

Namely, the inverse VLC element 52 sets sequence start flag Si 00 when It detects the leading portion 
of sequence to be decoded...thus to decode header information. ,Bjt. stream syntax in the sequence layer is" 
as shpwn in the above-mentioned .Table. 1., Also in this case., as! shown.. in the Table 1 and the FIG 4 
mentioned above, lateral size. (i.e., N) and longitudinal size- (i.e.. M).of picture frame can be recognized by 
flag expressed as ''horizontal_size^value^."vertical_si2e__value^ Moreover, whether or not Extra_Slice 
IS used can be recognized by^ flag .expressed as ^'using-extra^slice^flag". In the case where Extra__Slice 
IS. used. .lateral size and longitudinal size of picture portion Gi can be recognized by "inner mb width" 
"'""Q''»...'^b_height". , , . . , • , . . , . . . . 

Namely,. . ,^ . . , ^ •/ ' \ . 

Ni = inner mb width x 16 

Ml = inner_nnb__height.x.16 :i 



Thus, It Is seen that even in the case where the receiving side only has processing ability of N^ pixels x Mi 
lines, It Is possible to reproduce only picture portion^ Gi . 

Further, position Information, of picture portion Qi within N pixels x, M lines of the entire, picture, frame 
can be recognized by "offset__slice Jorizontal-position;', "offset_slice_^vertical^position". 

When inverse VLC element 52 detects the leading portion of picture to be decoded, it sets picture start 
flag 8102 to deliver it to refererice picture ^control .element 58. The'.reWence picture control element 58 
outputs reference picture indication signals S58. S59 which will be described later when picture start flag 
S102 Is set to deliver them _ , . . . ' 

^ Mgreover-; similarly .tp 'the above, .picture ,start" flag '^^1 02 J s delivered .to putfiit picture control' element 
59. The output picture control element 59 outputs output picture indication signal S60 which will " be 
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described later when picture start flag S102 is set to deliver it to field memory group 57. 

The inverse VLC element 52 sets slice start flag S103 when ot detects the leading portion of slice. Bit 
stream syntax of slice layer is as shown in the Table 2 mentioned above. In the' case where Extra_Slice is 

used, "extra slice flag" of flag indicating whether or hot that slice is Extra_Slice is received;' At this lime, 

5 in the case where the extra slice flag is "1", Extra Slice Status Flag S105 is set. On the other hand, 

in, the case where extra_s!icejK_flag is "0",. Extra Slice_^Status^FIag SlOSjs reset. . ^ . . * 

t Here, in, the case where, the reeewing 'Side-'has, only processing ability of picture frame of Nr pixels. x 

Mi lines, when the Extra_j^Slice-Status Flag ,S105 is "1"r inverse VLC 52 reads, 'in a skipped manner, data 

of that slice layer to carry out search for the. next start code. On the other hand, when the* Ex- 

10 tra .SIice_Status_Flag S1:05 is "0", decoding of slice data is carried out. ; . ■ ■ ' 

"stice_start_Gode" is x00000101 xOOOOOl AF, and. the lower order 8 bits. indicate SVP(S!ice Vertical 
Position), on .the entire picture , frame (N xr.M) of that slice. iAt the leading portion of slice, the first macro 
block J, has ..data indicating. SHP (Slice -i_Hori2ontal__Position). on the entire picture frame (N x' M). With 
respect to the vertical and horizontal positions (SVP, SHP) thus obtained, it is ' necessary- to* remove their 

76 offset . positions. These' .offset .jinformation are given;, by " . .off set_j_sliee^horizohtal position'*,* "off- 

^®*^^''^®^^®''^'^^'__P*^sition", which: have been already obtained in the sequence layer (see FIG. 4). 

Accordingly, at the time of decoding slice data; decoding- apparatus for reproducing only picture portion 
Gt carries out an operation described belowiM' . . . . ^ . ; . - 

SVP = SVP-offset slice vertical-position 

20 SHP = SHP-offset__slice^hcri^ont3l^position * - * - • ■ : . . ; . 

It is to be noted that GOP start flag S101 is also dutputted from the inverse VLC element 52:' 
■ Coded block, signal S5G which' has- = been- taken out from inverse- VLG element 52 Is delivered to two- <*• 
dimensional signal generating section 53, at which two-dimensional block signal S51 is obtaihed'. The two- 
dimensional block signal S51 is delivered-tbi block signal. decoding section 54, at*which it is decoded. Thus, ^' 
25 block reproduction difference signal S52 is obtained. > ■ 

As configuration of the block .signal decoding section' 54, configuration, composed of r..an inverse 
quantizer for inverse-quantizing quantization coefficients by quantization table signal 557 which' has b'eeh - ^ 

taken out from inverse VLC element 52 and' an inver-se DCT element for* allowing output cdefficients --^^ ^ 

therefrom to undergo inverse DOT (Discrete^ GosineiTransfdrm) processing-may be applied. '* - ' * ' V 
30 As . configuration' of the two-dimensional slgr^al generatirig sectiori 53; configuration 'comprised of an ^ ? 

inverse scan converter for implementing Mn-v^r^se: 'zigzag 'scanning to coded block signal S5 - >- <^ 

coefficients from low frequency to high frequency' may be applied. , j 

On-the other hand; motion vector signal S5 5,' motion compensation mode signaL 856' belonging to ^-^ > ^ 

macro block to be currently decoded which has been taken out from inverse' VLC element 52 are inputted ^ ' ^ 

35 to motion -compensator 56. Responding' to these inputs, motion compensator 56 instructs field memory 

group 57 in which pictures already decoded and reproduced' are stored to output corresponding block ' ... 
picture signal therfefrom'. • ■= ^ "' / ■ 

In more practical sense, the 'motion compensator 56 recognizes, as reference picture,' reproduction - 
picture designated from field memdi^y group 57 by the previously described reference* picture indication 
40 signal S58 'to instruct output) -of = block'- picture - signal ''pciisitid^ address within' reference picturef 

designated by motion'Compensation mode signal S56 and motion vector signal' S55:' ■ ■ ' - • ' 

In this embodiment, since picture portion 'Gi is coded with the predictive range befng lirhited in the 
coding apparatus,* address within reference picture indicated by motion' compensator 56 is sLibstantially 
limited to the area of picture portion Gi. of reproduction picture at the time of coding picture portion Gi, 
45 Motion compensator 56 carries out adaptive operation corresponding to motion compensatiori mode 

signal 856, i.e., carries out four kinds of operations described below in macro block units. Size of macro 
block is, e.g. 16 X 16 pixels. » ■. - . f-- 

Namely, as modes of four kinds of operations, there are modes described below similarly' to the 
previously described case: 
50 First, motion compensation mbdie fronn past reprbduc^^^ ' ' * ; * • - ■ - ' 

Secondly, motion compensation mode from future reproduction picture; ' ' 

Thirdly, mbti6n cdmpensatiort"mode from both past and future reprocluctldn pictures (to carr^ out linear 
operation (e.g.. mean value calculation) every pixel' of reference block frorri past reprqdu'ctioh* picture and 
reference block from future reproduction picture); and, , ' 

55 Fourthly, rriode of no motion* corn pen saitidn (i.is., intra-coded mode. In this* case, output of block picture 

signal S54 is equal to* zero). ' ' * ' ' '* ' • * * * - ' ' • . - 

Block reproduction difference signal S52 is added every piXel' at aclder '56 to block picture signaL S54 
outputted from rhotioh" com pensat6t\5i3\^^ a result, block 'reproduction signal 853 is obtained. This* block 
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reproduction signal S53 is stored into field memory designated by current picture indication signal S59 from 
within field memory groop 57. 

In a manner-stated above, moving picture decoding apparatus is constructed, thus \o reproduce picture 
from bit stream. This reproduction picture is outputted as output picture from terminal 60. 

A moving picture coding apparatus (encoder) of a second embodiment will now be described in 
accordance with FIGS. 6 and 7 with respect to differences between this embodiment and the above- 
descnbed first embodiment. It should be noted that since respective components of FIG.' 6 are substantially 
similar to tho^e of FIG. 1, their explanation is omitted here. 

The coding apparatus of this embodiment handles picture as indicated by A and B of FIG 7 Namely 
the upper N^. lines of picture (Ni is multiple of 16, e.g...48p;. etc.) are comprised of one general slice or 
more, and 16 lines of the lowest portion are comprised of one Extra_Slice or more Extra Slice is 
composed of Macro Blocks (MB) similarly to general slice. It-is to be noted that lower lines. picture 
may be comprised of general slices, and the highest 16 lines may be constructed as Extra__Slice. In 
addition, the Extra__Slice is only allowed by one stripe (one lateral, row of macro block on picture). 

Bit stream syntax of sequence layer is shown in Table. 3. 

' ' • - Table 3 ^ , j; • . ; ; 

sequence_header ( ) { ^ - ... v : ^ i - ; % 

sequence__header_code ; - ^ • . 32bit 

horizontal_size_value ; 12blt 
vertlcal_size_value; ' ' ' ' 12bit 
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10 



20 



25 



30 



pel _aspe,c t._r a.tio ; 
picture ,_,ra t,e;;. ; „ ... 
bit ^rate ; 

'tnarker_b'i t ' ' ' - . • \[ ' /.^ ' / , ^ 

vbv _buf f er_size ; ' ' ^ ' ' 

constrained _parame ter -'^ifaa© ;; ■ " ' 
loadj^intra _quant izer -iimatrlx ; - ' • ■ 
if (load _intra _q.uan tizen. _ma tr i.x ) ^ 

intra _quantizer _mat rix [ 64 ] ; 
load_non _intra _quantizer _matrix; 
ifdoad _non _intra _quantizer _matrlx), 

non __intra _quantizer __matr ix[ 64 ] ; , . 
, next_start _code( ) ; ' , . . 

if (next _bits ( ) = = extension _start _code)^ { 

extension _start __code ; 

pic ture__structure ; 



4bit,:.. 
^4bit.; 
ISbitr 
' ■■' ItDit ; 
lObit; 
• ibii::* 
Iblt; 

8»64bi t ; 
Ibit ; 

8«64bi t.; 



32bit ; 



Ibit; 



35 



40 



45 



using _extra _slice _flag; 
extra __slice _ver tical_position ; 



Ibit; 
Ibit; 



reserved (by te _align) ; 

while(next„bits( )! ='0000 0000 0000 0000 0000 0001') { 
sequence_extension _data; 8bit; 

} 

next start _code(); 



50 



55 
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if(nextbits( ) =user_data_s tar t _code ) { 
user_data_star t code : 



32bit ; 



while (next_bits ()!=' 0000 OQOO 0000 0000 0000 0001') { 



user data ; 



8bit ; 



10 



15 



next start code(0 ; 



In this Table 3, longitudinal size of picture frame is transmitted by "vertical size value". 

Moreover, information indicating whether or not Extra_^Slrde is used is transmitted by flag expressed as 

20 "using-extra_slice-flag". Further, position on picture of Extra Slice is transmitted by "ex- 

tt'a slice_yertical position". VVhefher the , highest portipn | of .picture is. Extra_.Siice;or not,; and whether the 

lowest porfioh^ of picture is Extra Slice or not are discriminated by,, "1", "0" :of the. r "ex- 
tra slice_vertical position", respectively. ... >^ ' . . J - - 

Bit stream syntax of slice layer is shown in Tabie 4. , ■ , . , , i . 

25 ■ ■ ' ' ' " . ' ''. ' ... 



30 



fable 4' 



slice C) "^ { ' 

slice Ustart code; 



32bi t ; 



35 



quantizer scale; ^ 
whtie^(next_bits ( ) = = * l ' ) { 
extra ^bit _slice;. t 



5bit i 



lbit = " r' 



40 



45 



50 



55 



extra information • slice; 



} 



8bit,; 



extra _blt _sli.ce : . . ^ ...... ^ . lbLt="0' 

.macroblock ;. I- - ^-.-r - ■ ^ > ' ' k t ^ 

, } whlle(ne.xtl_bits(J •00pp^ OOOQ OOOO 'OOOO ppOO').;.. . 

^.next' start ^code{),; , . . . . 



h 
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Further, start code Table is shown in Table 5. 

Table 5 



nanne 


hexadecimal value 


picture - start code 


00000100 


;slice start codes (including slice vertical positions) 


00000101 through 000001 AF 


extra slice start code 


000001 BO 


reserved 


' 000001 B1 


user_data start code 


000001 82 


sequence header code 


^ 00000183 • - ' . -^ 


sequence error code 


000001 84 


extension start code 


000001 85 


reversed 


000001 86 


sequence end code 


000001 87 


group start code 


000001 88 


system start code(see note) 


000001 89 through 000001 FF 


NOTE-systenn start codes are defined Jn. Part tCD 1,1172 . 1 . = . . . 



^ In the above Table 5; start code of g^n^ral slice is' xOOOOOI OI - xObOOOl AF/and start code of Extra 
Slice is xOOOOOIBO. In (general slice; ' the " lower order 8 bits' of start' code Indicate vertical position 
(Slice Vertical Position) of that slice on "picture except for Extra Slice". t • {- 

When Extra__Slice Status_FIag 328 is set, start code'of Extra_Slice is transn^itted. In'contrastf when 

Extra SIice_Status Flag S28 is not set, start code of general slice is transmitted. 

The differences. between the coding apparatus of tlpe second embodiment and the coding apparatus of 
the first embodiment have been described above. * ' ' 

A moving picture decoding apparatus (decoder) corresponding to the above-described- coding appara- 
tus of the second embodiment will now be described in accordance with FIG. 8 with respect to differences 
from the. decoding apparatus of the first embodiment. It is to be noted that in FIG. 8, the- same reference 
numerals are respectively attached to components similar to those of FIG. 5, and their explanation is 
omitted. 

In FIG. 8, inverse VLC element 52 sets sequence start flag 8100 when it detects the leading portion of 
sequence .to ^be decoded to decode header information. Bit stream syntax in the. sequence layer is as 
shown in the Table 3 mentioned above. In this case, longitudinal size of picture frame can be recognized by 

"vertical size value". In addition, whether or not Extra Slice is used is discriminated' by flag expressed 

as "using-extra slice_flag". 

When "vertical_size_value" is 496 lines and "using-extra_slice-flag" is "1", it is seen that even in the 
case where the receiving side is decoding apparatus only having processing ability of picture frame of 480 
lines, only the decodable picture portion can be reproduced. 

Moreover, position on picture of Extra Slice can be recognized by "extra_slice__vertical position". 

Whether, the highest portion of picture is Extra Slice or not,>and whether the lowest portion of picture is 

Extra Slice or not are respectively discriminated by "1", "0" of "extra slice vertical_position". 

Inverse VLC element 52 respectively sets slice start flag SI 03 and Extra Slice_Start Flag S105 

when it detects the leading portion of general slice and the leading portion of Extra Slice, respectively. Bit 

stream syntax of slice layer is as shown in the Table 4 mentioned above. Further, start code Table is as 
shown in the Table 5 mentioned above. Start code of general slice is xOOOOOIOI ~ xOOOOOIAF, and start 
code of Extra__Slice is xOOOOOIBO. In general slice, the lower order 8 bits of start code indicate vertical 
position of that slice (Slice Vertical Position) on "picture except for Extra Slice", 

Slice start flag S103 and Extra_Slice__Status Flag S105 are delivered 'to Set/Reset flip-flop 101. 

When the Extra_Slice_Status_Flag S105 Is "1", flag S106 is set to "1". Oh the other hand, when slice 
start flag S103 is "1"Vflag sVo6 is set to "0".' When flag S106 is "1", in'the cas^ where' decddihg apparatus 
of this embodiment has an ability to handle only picture of picture frame of frame of 720 pixels x 480 lines, 

inverse VLC element 52 reads, in a skipped manner, data of Extra Slice layer, thus to carry out search for 

the next start code. 

The differences between the decoding apparatus of the second embodiment and that of the first 
embodiment have been described above. 
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Finally, a method of transmitting Extra Slice as a third embodiment in the case where input picture is 

interlaced signal, and picture .structure is field structure will now be described by taking an example of a 
coding .apparatus (encoder) of modification of the above-described embodihhent. ; ■ * ^ ' 
, In .the case where picture structure is field structure (see A of FIG. 9), picture of field FDi and picture of 

5 field FD2 are independently^ coded as indicated by B of FIG. 9. Accordingly, for example, Interlaced picture 
of 486 lines at picture frame of frame consists of picture of field FDi, and picture' of field FD2 of 243 lines. 
For this reason, in the casei of j carrying out coding by using motion compensating predictive coding such as 
MPEG, handling is carried out under the- condition where longitudinal size is assumed to be multiple of 16 
and respective pictures are ^assumed to be 256 lines (240 + '16 lines) as indicated by C of FIG. 9. However. 

70 such a handling was problem in that since processing of '512 lines (256 + 256) is carriecf out at picture 
frame of frame, increase in the coding processing ability bf about 7% was required as compared to the 
case where frame of 480 lines is handled. 

In this embodiment, in the case where picture structure is field structure as shown in FIG. 10, 8 liriies oi 
field FDi and 8 lines of field FD2 of A and C of FIG. 10 are synthesized to constitute Extra_Slice of 16 

75 tines as indicated by B and D of FIG. 1€.' At: this time, there 'are 'assumed the base where Extra_Slice is 
frame structure and the case iWhere the upper 8 liries are field^ ^FDt' as indicated by A of FIG. 10 and the 
lower 8 lines are field FD2 as-indicated by C»of FIG. 10 (dr combination 'opposite to the above).' By taking 

into consideration good coding, efficiency and easiness of handling'. Extra Slice is dealt as frame structure 

in this embodiment. . , * - ^ ' • ' ' 

20 In this case, interlaced picture of 496 lines at picture friame^of frame consists of picture of 'field FDi and 

picture of field FD2 of 240 lines comprised of general slices, and' Extra__Si ice of the frame structure of 16 
lines, Extra^Slice is transmitted at the highest portion or the- lowest portion of 'picture of field FD2' It is to 
be noted that. Extra^Slice is only allowed by one stripe on ohe picture (lateral one row of macro block on 
picture). 

25 The differences between the third embodiment and the second embodiment will now be described in 
accordance, with the circuit diagram shown Jn a block form; in FIG: 6. ' • 

Bit stream syntax of the sequence layer is. as shown Jn theTable 3 mentioned above. LongitUdihkl size 

of picture frame is transmitted by "vertical size value''. f ' ' ' " - • 

Moreover, discriminator relating to structure of picture is transmitted by "picture_structurB". In the case 
30 where , "picture__structure" .= vo", structure of picture is frame structure. ^On th^ other hand, in the case 
where "picture_structure" = "1 structure of picture is field structure. ' ■ . • 

Moreover, information indicating whether or not Extra__Slice is used is transmitted by flag 'expressed as 
"using-extra_slice-flag". Further, position on picture of Extra_Slice is transmitted by "ex- 
tra_slice_vertical_position". .Codes for respectively discriminating whether or not 'th^ highest portion of 

35 picture of field FD2 is Extra Slice and whether or not the lowest portion thereof is Extra_Slice by "1", "0" 

of "extra^slice vertical position" are transmitted. \ ■ >. . m ^ 

It is to be . noted that while Extra^Slice is added to picture of -field FD2^ in this e'mbodiment, it may be 
added to picture of field FDi . , .,, . , , . ; , 1 ,v ,/ ; ^ ^ , : *> 

The differences ^between the coding apparatus pf the .third: embodiment and that of the second 
40 embodiment have been described above; ■ , — : f / r ^ - - 

A moving; picture decoding apparatus (decoder) corresponding to the above-described coding' appara- 
tus of the, third embodiment will now be described with reference to FIG. 8 with respect to differences from 
the second embodiment. , . . - — 

Inverse VLC element 52 sets sequence start flag SI 00 when it detects the leading portion of sequence 
45 to be decoded, thus to decode header information. Bit stream syntax in the sequence layer is as shown in 
the Table . 3 mentioned above. Longitudinal size - of picture frame can ' be recognized ' by "verti- 
cal__size_value;\ Further, whether . or .not Extra__Slice is used is discriminated by flag expressed as 

"using-extra slice_flag". It is seen that when "vertical__size_value" is 496 lines and "us- 

'"9__?>^^'*s slice flag." is "1", even in the case .where there is employed decoding apparatus only having 

50 processing ability of picture frame of 480 .lines, only its decordable picture portion can be reproduced. 

In addition, position on picture of Extra__Sllce can be recognized by "extra_sllce__vertical_position". 
Whether or not the highest portion, of picture of field frOz is Extra_^SIice and whether or not the lowest 
portion thereof is Extra Slice are respectively discriminated by "1", "0" of "ex- 
tra slice vertical position".,, .> ^ ... . , * r . . n , , 

65 The differences between the decoding apparatus of the third embodiment and that of the second 
ernbpdiment have been described, above,., ^ .,1 : . j- , i >, 
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Industrial Applicability 



In this invention, ..as desc;:ibed above, it. is. possible to provide nnoving * picture coded inforniation' 
(broadcasting) having flexibility,, supti .that, for example, in the case where the receiving side has decoding 

5 processing ability, o^ picture , frame of 483 lines, or. more, received all picture signals can be reproduced, . 
while in the case where the .receiving ^ide onty^ihas decoding processing ability; of' picture frame of* 480 
lines, only its decordable picture portion, can be, reproduced, -r. , . , ,t , . 

Accordingly, it is, possible to take, out orily tpicture ^ information of reproducible- picture frame from * 
received coded information. For example, in, .the coding method using motion compensating prediction' 

10 between pictures, e.g., MPEG, etc., pictures have correlation therebetween in a time base direction. For this- 
reason, in the. case where reference is m.ade to the outside portion of reproducible picture frame by motion - 
cornpensation, motion conipensation is caused to be;unable, thus permitting decoding to be disabled. 

Claims . , *. . . . ' . m 

. . „ , . : . . . .)•; . : , < : : ' 

1. A moving picture coding nnethod,, using nnption compen.sati : • • 

wherein .a picture .signal, of a .picture fname of N pixels x M - lines- ^(horizontal N pixels, vertical M 
lines) to be coded is divided between.. a , first .pipture portion serving as. am internal picture portion having 
; a picture frame of pixels x Mi line;S" (IVi N, Mi M) and a second .picture portion' serving as a ' 
20 picture portion outside the first picture portion, and . . - . / . 

J wherejn the first, picture portion ^ and; the -second picture portion ^are divided in independent 
J predetermined divisional units comprised of. aipiurality of pixels. ; • * - 

, whereby,, in transmitting cpded .information, of the predeterrnihed di visional units betonging to the * 
secpnd picture portion, peculiar discrimination codes are respectively added to headers 'of -the divisional 
25 units. . , „ . 

2. A moving picture coding method as setforth^n claim-^rl; wherein, at the time'of rtiotioh cbmpensating 
prediction., it is inhibited that, the first picture^ portion of a picture to be curr-entiy coded rhakes- refer^ce 
to the second picture portion of a reference pictu'r'ej '!f ^ * ■ , - ' - - • • • 

3. A movirig picture ..(^qding method asi-setuforth in-ietaim 2, -wherein motion compensatiridf* prediction 
implemented to the second picture .portiort of a picture to be currently' coded does hot place restrictions 

. on the reference pic.ture^ . ; .-i?.." i ' . ; i . • • - ^ ^- 

35 4. A moving picture decoding method for decoding a coded signal of a -moving picture ijsing motion 
compensating prediction, . ■ \ • . . . . i.- - . : • • 

wherein in the case where a picture signal of. N pixels x* M lines (horizontal N pixels, Vertical M 
, fines) is divided .between a first, picture portion serving as an ihfernai picture portion having a picture 
frame of Ni pixels x Mi lines (Ni ^ N, Mi ^ M) and a second picture portion serving as a picture ' 

40 portion outside. the first picture, pofition, When only decoding ability of the picture' frame of' NV pixels x 

Ml lines is provided, only the firist picture portion is reproduced to detect 'any one of peculiar ' 
djscrinriination: codes added ito headers =of^ coded information of predetermined divisional ijnits com- 
prjsed.pf a plurajity of pixels,- belonging to4he second picture portion with resepct to the' second picture 
portion to thereby discriminate it, thus to read, in a skipped manner, coded information of the second ' 

45 picture portion. i - ' . ' < • • ' ■ i . - ... 

5, .A moving picture coding method >as:set forthnn claim 1, wherein when size of' unit block for carrying out 
motion compens.ating predletron; is N2 pixels x M2 lines; Ni is multiple of' N2 and Mi' is multiple of M2 . 

.... , , . ... , . . i i • .^f' . \; - 

50 6. , A moving picture decoding, method as* set forth in claim 4, wherein- when si^'e of unit block for carrying 
out motion compensation is N2 pixels x M2 lines.'Ni is rttultipte'of N2 arid'Mi' is mult'iple'of M2.' / * 

7. A moving picture coding method as set forth' in- claim 1, wherein Ni and Mi are both' multiple of 16. 

55 8. A moving picture decoding method as set forth in claim 4, wherein Ni and Mi are both multiple of 16, 

9. A moving picture . coding method as set forth in claim 2, wherein* a frame picture signal' to ' be 
transmitted is a picture signal having 483 lines or more required for the television broadcasting of the 



19 

• f 

BNSDOCID: <EP 0650298A1_I_> 



10 



20 



EP 0 650 298 A1 

NTSC system, and Mi lines of the first picture portion are 480 lines. . . . 

10. A moving picture decoding method for decoding a coded -signaP of ;a moving picture using motion 
compensating prediction, • ) ,, 

V- • wherein in the case where a frame picture ^-signat-^ having 483 lines or • more required for the 
television broadcasting of the NTSC system is divided between a first picture portion of 480 lines' and a 
second picture portion serving as a picture portion of the highest portion or the lowest portion of a 
portion except for the first picture portion, when onlydecoding ability of a picture frame of 480 lines is 
provided, only the first picture portion is reproduced to detect any one of peculiar discrimination codes 
added to headers of coded information of predetermined divisional units comprised of a plurality of 
pixels belonging to the second picture- portion with respect to 'the second picture portion to thereby 
discriminate it. thus to read, in a skipped manner, coded information of the second picture portion. 

11. A moving picture coding method using motion compensating prediction, 
the method comprising the steps of: 

dividing a first picture into two kinds of first and second regions; 
coding at least the first region; and 

implementing motion compensating prediction to a second picture only from the first region to 
encode it. 

12. A moving picture coding method as set forth in claim 11, 

wherein the first region is a slice including at least one macro block. 

13. A moving picture coding method as set forth in claim 11, 

25 wherein discrimination codes for discriminating between the first and second regions are added to 

respective headers. 

14. A moving picture decoding method for decoding a coded signal of . a moving picture using motion 
compensating prediction, ^ 

^0 the method comprising the steps of: 

decoding, from a coded signal of a first picture divided into two kinds of first and second regions 
only the first region; and . ' 

implementing motion compensating prediction to a coded signal of a second picture only from a 
decoded signal of the first region. y ■ « 

35 

15. A moving picture decoding method as set forth in claim 14, 

wherein the first region is a slice including at least one macro block. 

16. A moving picture decoding method as set forth in claim 14, 

40 wherein discrimination between the first and second regions is made on the basis of discrimination 

codes added to respective headers. 

17. A moving picture coding apparatus using motion compensating prediction. 

the apparatus comprising; ' . 

45 means for dividing a first picture into two kinds of first and second regions; 

means for coding at least the first region; and 

means for implementing motion compensating prediction to a second picture only from the first 
region to encode it. 

50 18. A moving picture coding apparatus as set forth in claim 17, 

wherein the first region is a slice including at least one macro block. 

19. A moving picture coding apparatus as set forth in claim 17, 
the apparatus further including: 

66 means for adding discrimination codes for discriminating between the first and second regions to 

respective headers. ^ 



20 



3 



EP 0 650 298 A1 



20. A moving picture decoding apparatus for decoding a coded signal of a moving picture using motion 

compensating prediction, ■ , . . • ' , ' ' • i, 

the apparatus comprising: 

means for decoding, if rom a coded signal of a/first picture divided into two kinds of first and second 
regions, only the first region; and • • 

means for implementing motion; compensating- prediction to a ■coded signal of a second picture 
only from a decoded signal of the first /egion. = >= ; ;>..•'•;•> 



10 



21. A moving picture decoding apparatus as set forth claim 20/ > 

, where.in the first region is a slice including at least one macro block. 



15 



22. A moving picture decoding apparatus a? sot forth in "claim 20, • . ■ • • 

.tine apparatus further including: . ■ . , ' , 

means for discriminating between the first and second regions on the basis of discrimination codes 
added to respective headers. .... : ,c , i - ... , , . {■ 
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